


I Office I 




INVESTOR IN PEOPLE 



The Patent Office 
Concept House 



o 




CERfTIFIED COPY OF 
PRIORITY DOCUMENT 



Cardiff Road 
Newport 



South Wales 
NPIO 8QQ 



I, the undersigned, being an officer duly authorised in accordance with Section 74(1) and (4) 
of the Deregulation and Contracting Out Act 1994, to sign and issue certificates on behalf of 
the Comptroller-General, hereby certify that annexed hereto is a true copy of the documents 
as originally filed in connection with the patent application identified therein together with the 
Statement of inventorship and of right to grant of a Patent (Form 7/77), which was 
subsequendy filed. 



In accordance with the Patents (Companies Re-registration) Rules 1982, if a company named 
in this certificate and any accompanying documents has re-registered under the Companies Act 
1980 with the same name as that with which it was registered immediately before re- 
registration save for the substitution as, or inclusion as, the last part of the name of the words 
"public limited company" or their equivalents in Welsh, references to the name of the company 
in this certificate and any accompanying documents shall be treated as references to the name 
with which it is so re-registered. 

In accordance with the rules, the words "public limited company" may be replaced by p. I.e., 
pic, P.L.C. or PLC. 

Re-registration under the Companies Act does not constitute a new legal entity but merely 
subjects the company to certain additional company law rules. 




THIS PAGE BUNK (ospio) 



V ^Pat! 



Form 1/77 



Patents Act 1977 
(Rule 16) 





Request for a gran 



(See the notes on the back of this form you can also get an 
explanatory leaflet from the Patent Office to help you fill in 



The Patent Office 

Cardiff Road 
Newport 
Gwent NP9 1RH 



1. Your reference 

21 


P010113GBRWP 

FEB 2001 


— 22FEB81 mmZ i D822'i6 


2. Patent application number 

fThe Patent Office will fill in Oiis part) 


0104296.9 


,P01/??Q0 0.00-0104296.9 



3. Full name, address and postcode of the 
or of each applicant 
(underline all surnames) 



SONY UNITED KINGDOM LIMITED 

THE HEIGHTS 

BROOKLANDS 

WEYBRIDGE 

KT13 0XW 

UNITED KINGDOM 



Patents ADR number (if you know it) 

If the applicant is a corporate body, give 
the country/state of its incorporation 



4. Title of the invention 



SIGNAL PROCESSING 



5. Name of your agent (if you have one) 

"Address for sen/ice" in the United Kingdom 
to which all correspondence should be sent 
(including the postcode) 

Patents ADP number (if you l<now it) 



D YOUNG & CO 

21 NEW FETTER LANE 
LONDON 
EC4A1DA 

59006 



If you are declaring priority from 
one or more eariier patent 
applications, give the country and 
date of filing of the or each of these 
earlier applications and (if you l<now 
it) the or each application number 



Country Priority application Date of filing 
number (day/month/^ear) 
(if you know it) 



1st 



2nd 



3rd 



7. If this application is divided or otherwise Number of earlier Date of filing 

derived from an eariier UK application, application (day/month/year) 

give the number and filing date of the 
eariier application 



Is a statement of inventorship and of right td''g;^nit..of a patent 
required in support of this request? (Answer 'Yes' ifr:^^^% 

a) any applicant named in part 3 is not an inventor, or 

b) there is an inventor who is not named as an applicant, or 

c) any named applicant is a corporate body. 
See note (d)) 



YES 



9. Enter the number of sheets 
for any of the following items 
you are filing with this form. 
Do not count copies of the 
same document 



Continuation sheets of this form 

Description 

Claim(s) 



Abstract 
Drawing(s) 




1 0. If you are also filing any of the 
following, state how many 
against each item 



Priority Documents 



Translation of Priority Documents 



Statement of inventorship and right to 

grant of a patent (Patents Fonv 7/77) 



Request for preliminary examination 

and search (Patents Form 9/77) 



Request for substantive 
examination (Patents Form 10/77) 



Any other documents (Please specify) 



J 

( 



11. 



I/We request the grant of a Patent on the basis of this application. 

Signature r\\ I i\ ^ Date 



D YOUNG & CO 

Agents for the Applicants 



21 Feb 2001 



12. Name and daytime telephone number of person 
to contact in the United Kingdom 



Richard Pratt 



023 80719500 



Warning ^. 

After an application for a patent has been filed, the Comptroller of the Patent Office will consider whether publication or 
communication of the invention should be prohibited or restricted under Section 22 of the Patents Act 1977. You will be 
informed if it is necessary to prohibit or restrict your invention in this way. Furthermore, if you live in the United Kingdom. 
Section 23 of the Patents Act 1977 stops you from applying for a patent abroad without first getting written permission from the 
Patent Office unless an application has been filed at least 6 weeks beforehand in the United Kingdom for a patent for the same 
invention and either no direction prohibiting publication or communication has been given, or any such direction has been 
revoked. 

Notes 

a) If you need help to fill in this form or you have any questions, please contact the Patent Office on 01645 500505. 

b) Write your answers in capital letters using black ink or you may type them. 

c) if there is not enough space for all the relevant details on any pari of this form, please continue on a separate sheet of 
paper and write "see continuation sheet" in the relevant part(s) Any continuation sheets should be attached to this fonn. 

d) if you answered 'Yes' Patents Fbrni 7/77 will need to be filed. 

e) Once you have Wed in the form you must remember to sign and date it. 



f) For details of the fee and ways to pay please contact the Patent Office. 



C ^at^^ Form 7/77 

Patents Act 1977 
(Rule 15) 



Statement of inventorship and 
of right to grant of a patent 




&CO 



The Patent Office 

Cardiff Road 
Newport 

Gwent NP9 1RH 



1. Your reference 



P010113GB RWP 



2. Patent application number (If you know it) 



0104296.9 



2 1 FEB 2001 



3. Full name of the or of each applicant 



SONY UNITED KINGDOM LIMITED 



4. Title of the invention 



SIGNAL PROCESSING 



5. State how the applicantfs; derived the right from the BY VIRTUE OF AN ASSIGNMENT, 
inventorfs) to be granted a patent 



6. How many, if any, additional Patents Forms 7/77 are 
attached to this form? (see note (c)) 



l/We believe that the personCs) named over the page 
(and on any extra copies of this forms) is/are the 
inventorfs; of the invention which the above patent 
relates to. 



Signature 




D YOUNG & CO 

Agents for the Applicants 



Date 



21 Feb 2001 



8. Name and daytime telephone number of person 
to contact in the United Kingdom 



023 80634816 



Richard Pratt 



Notes 

a) If you need h^p to f3l in this form or you fiave any questions, please contact the Patent Oflfce on 0645 500S05. 

b) Write answers in capital letters using black ink or you may type them. 

c) If there are mom than three inventor, please write the names and addresses of the other inventors on the back of another Patents Fonn 7/77 and attach it to 
this form. 

d) When an appScation does not dedare any priority, or declares priority ftom an earSer UK appScaSon. you must provida enough copies of this form so that the 
Patent Office can send one to each inventor wtto is not an appScant 

e) Once you have fSed in the form you must remember to sign and date it PSfl© 1 



Enter the full names, addresses and 
postcodes of the inventors in the boxes 
and underline the surnames 



.-D Young & Co ref: P010113GB RWP 



Surname SAUNDERS 



First Names Nicholas Ian 
Address 



21 Mongers Piece 
Chineham 
Basingstoke 
Hampshire 
RG24 ORL 
United Kingdom 



Patents ADP number (if you know it): 



6 ^^feZ^^'cOo^ 



Surname PORTER 



First Names Robert Mark Stefan 

Address 8 Prince Andrew Close 
Maidenhead 
Berkshire 
SL6 8QH 
United Kingdom 



Patents ADP number (if you know it): 



Surname 

First Names 
Address 



Patents ADP number (if you know it): 



Reminder: 

Have you signed the form? 



Page 2 



1-00-66, P/lOl 13GB 1 

Signal Processing 

The present invention relates to a signal processing system, a method of signal 
processing and a computer program product arranged to implement the method. 
Embodiments of the invention relate to processing compressed video bit streams. 
Preferred embodiments relate to processing video bit streams compressed according to 
the MPEG 2 standard. 

The invention and its background will be discussed by way of example with 
reference to MPEG-2 video bitstreams. However the invention is not limited to 
MPEG-2. 

MPEG-2 is well known from for example ISO/IEC/13818-2, and will not be 
described in detail herein. MPEG-2 compressed video comprises groups of I, P and/or 
B frames known as GOPs, Groups of Pictures. I, P and B frames are well known. An 
I or Intra-encoded frame contains all the information of the frame independently of any 
other frame. A P frame in a GOP ultimately depends on an I frame and may depend 
on other P frames, A B frame of a GOP ultimately depends on an I-frame and may 
depend on P frames in the GOP. A B frame must not depend on another B frame. 

A GOP typically comprises 12 or 15 frames comprising at least one I frame 
and several P and B frames. To correctly decode a GOP requires all the frames of the 
GOP, because a large part of the video information required to decode a B frame in the 
GOP is in a preceding and/or succeeding frame of the GOP. Likewise a large part of 
the video information required to decode a P frame is in a preceding frame of the GOP. 
More generally, a GOP must comprise at least one I frame. It may additionally 
comprise one or more P frames and/or B frames. For example, a GOP may comprise 
only an I frame and a B frame as in the SX system of SONY. 

It is known to edit compressed video or otherwise process it. A known editing 
process is splicing. Splicing analogue signals is relatively straight forward and can be 
done at the boundary between adjacent frames, because each analogue frame contains 
the whole of the video information of that frame independently of other frames. 
Splicing can be done similarly in the digital domain for both compressed and 
uncompressed video data if all frames contain the whole video information of the 
frame. Thus it has been proposed to splice compressed video by reencoding an original 
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GOP of I and P and/or B frames as all I frames and perfomiing splicing on the I frames 
and then reencoding the I frames as a new GOP having the same structure as the 
original GOP. Other processing is also conveniently performed on I frames. 
Reencoding the original GOP as I frames involves decoding the GOP to baseband and 
5 receding to I frames. Alternatively, it has been proposed to decode a GOP of 
compressed video to digital baseband (i.e. uncompressed digital video), process the 
baseband video, and reencode the processed video as a compressed bitstream without 
the intermediate step of recoding to I frames. 

Decoding and reencoding tends to reduce image quality. It is known to 
10 maintain image quality by storing the compression parameters of compressed video 
before it is decompressed and to reuse those stored parameters, for at least frames 
which have not been changed by the processing, when reencoding the video. For 
example, I frames of the original compressed video are reencoded as I frames with the 
same compression parameters as in the original video. Likewise P and B frames of the 
15 original video may be reencoded as P and B frames with their original compression 
parameters. An example of such processing is disclosed in European Patent 
Application 00306696.6 ( Atty. ref 1-99-21 S00P5205EP00, P7374EP). 

• It is possible that a compressed video bitstream is decoded to I frames or 
baseband and then reencoded as a compressed bitstream with simple processing which 
20 does not change the video such as simple transfer and/or storage. 

It has been foxmd that decoding a compressed bitstream to I frames and 
reencoding the bitstream, whether or not the decoded bitstream is processed so as to 
change the video, results in the number of bits per GOP of the reencoded bitstream 
differing from that of the original bitstream even if compression parameters are reused. 
25 The same occurs if the compressed bitstream is decoded to baseband and reencoded. 
This can cause the buffer of a downstream decoder to underflow or overflow. 

It is desired to decode and reencode a compressed video bitstream whilst 
maintaining image quality and avoiding buffer underflow and overflow. 

According to a first aspect of the invention, there is provided a signal 
30 processing system comprising: 

a decoder for decoding a first compressed digital video bitstream whilst 
preserving the compression parameters thereof, the compression parameters including 
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C a first buffer occupancy value V_l representing the occupancy by the said first 

bitstream of a buffer of the decoder; 

a signal processor for processing the decompressed bitstream; and 
an encoder for compressing the processed bitstream to produce a 
5 second compressed bitstream having a target bit rate, optionally with reuse of the said 
compression parameters of the first bitstream, the second bitstream having a second 
occupancy value V_2 representing the occupancy of a downstream decoder buffer by 
the said second bitstream; 

wherein the encoder controls (i) the target bit rate of the second bitstream and 
1 0 (ii) the recoding of the second bitstream to meet the said target bit rate, 

the target bit rate being varied in dependence on one or both of (a) V__2 and (b) 
the difference between V^l and V_2, and 

the degree of reuse of the said preserved parameters being varied in 
dependence on one or both of (a) the degree to which V_2 tends towards underflow 
1 5 and (b) the degree to which V_l differs from V_2 tending towards imderflow. 

According to a second aspect of the invention, there is provided a method of 
processing a signal comprising the steps of: 

decoding a first compressed digital video bitstream whilst preserving the 
20 compression parameters thereof, the compression parameters including a first buffer 
occupancy value V_l representing the occupancy by the said first bitstream of a buffer 
of the decoder; 

processing the decompressed bitstream; and 

compressing the processed bitstream to produce a second compressed 
25 bitstream having a target bit rate, optionally with reuse of the said compression 
parameters of the first bitstream, the second bitstream having a second occupancy 
value V_2 representing the occupancy of a downstream decoder buffer by the said 
secondbitstream; 

wherein the encoding controls (i) the target bit rate of the second bitstream and 
30 (ii) the recoding of the second bitstream to meet the said target bit rate, 

the target bit rate being varied in dependence on one or both of (a) V_2 and (b) 
the difference between V 1 and V 2, and 
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the degree of reuse of the said preserved parameters being varied in 
dependence on one or both of (a) the degree to v^hich V_2 tends towards underflow 
and (b) the degree to which V_l differs from V_2 tending towards underflow 

According to a third aspect of the invention, there is provided a computer 
5 program product comprising instructions which when run on a suitable data processor 
implement the method of said second aspect of the invention. 

Thus the invention avoids underflow whilst preserving image quality by 
reusing preserved parameters and maintaining a high bit rate when the tendency 
towards underflow is low, and reduces the reuse of the preserved parameters and 
10 reduces the bit rate as the tendency towards underflow increases. Preferably, the values 
of V_l and V_2 are controlled so that they converge by controlling the bit rate. 

According to a fourth aspect of the invention, there is provided a signal 
processing system comprising: 

a decoder for decoding a first compressed digital video bitstream whilst 
1 5 preserving the compression parameters thereof, the compression parameters including 
a first buffer occupancy value V__l representing the occupancy by the said first 
bitstream of a buffer of the decoder; 

a signal processor for processing the decompressed bitstream; and 
an encoder for compressing the processed bitstream to produce a 
20 second compressed bitstream having a target bit rate, optionally with reuse of the said 
compression parameters of the first bitstream, the second bitstream having a second 
occupancy value V_2 representing the occupancy of a downstream decoder buffer by 
the said second bitstream; 

wherein the encoder controls (i) the target bit rate of the second bitstream and 
25 (ii) the recoding of the second bitstream to meet the said target bit rate, and 

if V_2 is tending towards overflow of the downstream buffer and/or V_2 
differs from V_l tending towards overflow of the downstream buffer, the encoder adds 
stuffmg bits to the bitstream and recedes the second bitstream reusing the said 
preserved parameters. 

30 According to a fifth aspect of the invention, there is provided a method of 

processing a signal comprising the steps of: 
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decoding a first compressed digital video bitstream whilst preserving 
the compression parameters thereof, the compression parameters including a first 
buffer occupancy value V_l representing the occupancy by the said first bitstream of a 
buffer of the decoder; 

processing the decompressed bitstream; and 

compressing the processed bitstream to produce a second compressed 
bitstream having a target bit rate, optionally with reuse of the said compression 
parameters of the first bitstream, the second bitstream having a second occupancy 
value V_2 representing the occupancy of a downstream decoder buffer by the said 
second bitstream; 

wherein the encoding controls (i) the target bit rate of the second bitstream and 
(ii) the recoding of the second bitstream to meet the said target bit rate, and 

if V_2 is tending towards overflow of the downstream buffer and/or V_2 
differs from V_l tending towards overflow of the downstream buffer, the encoder adds 
stuffing bits to the bitstream and recodes the second bitstream reusing the said 
preserved parameters. 

According to a sixth aspect of the invention, there is provided a computer 
program product comprising instructions which when run on a suitable data processor 
implement the method of said fifth aspect of the invention. 

Thus the invention reduces overflow of the downstream buffer whilst 
preserving unage quality by reusing the preserved parameters and adding stuffing bits. 

In preferred embodiments of the invention in which the bitstreams are 
compresssed according to the MPEG2 standard, V_l and V__2 are video buffer verifier 
values VBV 1 and VBV 2. 
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For a better understanding of the present invention, reference will now 
be made by way of example to the accompanying drawings in which: 

Figure 1 is a schematic block diagram of a system for decoding compressed 
video to baseband, processing the decoded video and reencoding the processed video; 
5 Figure 2 is a schematic block diagram of a system for decoding compressed 

video and receding it as I frames, processing the I frames and reencoding the 
processed I frames; 

Figure 3 is a diagram illustrating occupancy of a down stream buffer of the 
system of Figure 1, 2, 5 or 7, and illustrating control of overflow in accordance with an 
1 0 embodiment of the invention; 

Figure 4 is a diagram illustrating occupancy of a down stream buffer of the 
system of Figure 1 , 2 5 or 7, and illustrating control of xmderflow in accordance with 
an embodiment of the invention; 

Figure 5 is a schematic block diagram of a system for decoding compressed 
1 5 video to baseband, editing the decoded video and reencoding the edited video; 

Figure 6 is a timing diagram for explaining the operation of the system of 
Figures ; 

Figure 7 is a schematic block diagram of a system for decoding compressed 
video and receding it as I frames, editing the I frames and reencoding the edited I 
20 frames; and 

Figure 8 is a timing diagram for explaining the operation of the system of 
Figure 7. 

The illustrative system of Figure 1 comprises a decoder 2 which receives a 
digital video bitstream compressed according to the MPEG 2 standard. The bitstream 
25 comprises a "long GOP" of frames, for example IBBPBBPBBPBB. The decoder 2 
decompresses the compressed video to digital baseband. The compression parameters 
of the I, P and B frames are preserved for transfer to an encoder 6 as indicated by line 
12. The parameters include for all frames (i.e. I, P and B): 
Identification of the frame type, I P and B; 
30 Quantiser scale; 

DCT type ( field or frame); and 
Quantiser matrix. 
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The parameters additionally include for predicted frames ( i.e. P and B frames): 
Prediction type ( field or frame); 
Macroblock mode; and 
Motion vectors. 

5 The decompressed baseband video is applied to a signal processor 40. The 

processor 40 may be, inter alia: simply a communications channel for transferring the 
decompressed video to the encoder 6; a store for storing the baseband video; an image 
processing system for example an editing system; and/or a video processing studio 
which operates at digital baseband. 

10 The encoder 6 compresses the video from the processor 40 according to the 

MPEG2 standard producing in this example a long GOP which is preferably the same 
as the long GOP supplied to the decoder. The encoder uses the preserved transcoding 
parameters to compress the processed video and supplies the compressed video to a 
downstream decoder 8 having a buffer 10. 

15 The system of Figure 2 comprises a decoder 2 which receives a digital video 

bitstream compressed according to the MPEG 2 standard. The bitstream comprises a 
"long GOP" of 12 or 15 frames, for example IBBPBBPBBPBB. The decoder 2 
decompresses the compressed video to digital baseband. The compression parameters 
of the I, P and B frames are preserved for transfer to an encoder 6 as indicated by line 

20 12. The compression parameters are the same as set out above with reference to Figure 
1. 

The decompressed baseband video is applied to an intra-frame encoder 14 
which compresses the baseband video to I frames. The intra-encoder 14 uses the 
preserved parameters of the original I frames to recode those frames as I frames 
25 whereever possible within the constraints of the reencoded bitstream. The I frames are 
supplied to a signal processor 41. The processor 41 may be, inter alia: simply a 
communications channel for transferring the decompressed video; a store for storing 
the baseband video; an image processing system for example an editing system; 
and/or a video processing studio which operates on intra frames. 
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C The processed I frames are supplied to a decoder 16 which decodes them to 

baseband preserving the compression parameters of the I frames as indicated by line 
18 and transfers the baseband video to the encoder 6. 

• The encoder 6 compresses the video from the decoder 16 according to the 
5 MPEG2 standard producing in this example a long GOP which is preferably the same 
as the long GOP supplied to the decoder 2. The encoder uses the preserved transcoding 
parameters to compress the processed video and supplies the compressed video to a 
downstream decoder 8 having a buffer 10. 

The decoder 2 of Figures 1 and 2 has a buffer which has an occupancy VBV_1. 
10 VBV_1 is knovm at the decoder 2 by measuring it. The downstream decoder has a 
buffer the occupancy of which is VBV_2. VBV_2 is estimated at the encoder 6. 

In both the systems of Figures 1 and 2, assuming that the processor 40 or 41 
simply transfers the video without changing it in any way, it would be expected that, if 
the compression parameters are reused at the encoder 6 so as to reconstruct at the 

15 encoder 6 the long GOP input to the decoder 2, then VBV_1 wall be the same as 
VBV_2. However in practice it is found that VBV_2 differs from VBV_1 and that 
VBV_1 and VBV_2 tend to drift apart. This is believed to be due to various factors. 
One factor is rounding errors in the inverse DCT transform in the decoder(s) and in the 
DCT transforms in the encoder(s). Other factors which arise in the system of Figure 2 

20 are changes in frame type which may arise from the decoding of the original bitstream 
and reencoding the bitstream; for example a frame which was originally I may be 
recoded as P or vice versa. In such cases the quantisation scales change. Such errors 
are likely to' be worse in the system of Figure 2 than in the system of Figure 1. Figures 
3 and 4 illustrate the drift of VBV_1 and VBV_2. The drift may cause the downstream 

25 buffer 1 0 to underflow or overflow if it is not controlled. 

In accordance with an embodiment of the invention, the drift is controlled. 
Referring to Figures 3 and 4: VBV_2 is the occupancy of the dovmstream buffer 10 of 
Figures 1 and 2; VBV_1 is the occupancy of the buffer of the upstream decoder 2; and 
Buffer_size refers to the size of the downstream buffer 10. Thresholds VBV_Threshl, 

30 VBV_Thresh2, and VBV_Thresh3 are set. These thresholds are ail percentages of the 
Buffer_size. Examples of the thresholds are: 
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r , VBV_Threshl is 20% of Buffer_size; 

VBV_Thresh2 is 15% of Buffer__size; and 
VBV_Thresh3 is 10% of Buffer^^size. 

Figures 3 and 4 show in the heavy line GOPs of the original compressed 
5 bitstream input to the upstream decoder 2 and in the light line GOPs of the 
corresponding recoded bitstream produced by the encoder 6. The GOPs are long 
GOPs in the example of Figures 3 and 4 having a sequence of 15 frames 
IBBPBBPBBPBBPBB for example. Each type I, B and P of frame of the original 
bitstream is recoded as the same type I, B and P respectively of frame by the encoder 
10 6. 

A value VBV_drift is determined. VBV_drift is the difference (VBV_2- 
VBV_1) between the occupancy of the downstream buffer 10 by a frame of the 
recoded bitsream produced by the encoder 6 and the occupancy of the upstream buffer 
by the corresponding frame of the original bitstream. VBV_2 is also determined. 

15 VBV_2 and VBV_drift are determined once per GOP on the I frame of the GOP in 
this example. Altematively, they may be determined on each frame of the GOP or on 
several but not all frames, for example on I and P frames but not B frames. It is 
preferable to determine them at least once per GOP on an I frame, because I frames 
have the greatest occupancy of the buffers and may (but not always) produce the 

20 greatest change in occupancy. In other embodiments of the invention, VBV_2 and 
VBV_drifl may be determined every other GOP or at other suitable intervals. 
Overflow and positive VBV drift 

Referring to Figure 3, which illustrates VBV_2 drifting from VBV^l with a 
tendency towards overflow, VBV__drift and VBV_2 are determined once per GOP on 
25 the I frame at the start of each GOP.. 

If (VBV_2 > Buffer^size - VBV_Threshl) or (VBV^drift > 
VBV_Thresh3), then stuffmg bits are added to the GOP following the I frame in the 
encoder 6 to reduce VBV_2. The GOP produced by the encoder reuses all the 
preserved transcoding parameters when there is a tendency to overflow. By way of 
30 explanation, VBVJ2 is the occupancy of the downstream buffer 10, The occupancy of 
the downstream buffer is the inverse of the occupancy of the buffer of the encoder. 
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C . Adding bits at the encoder to increase its occupancy results in decrease of the 

occupancy of the downstream buffer. 

The threshold Buffer_size - VBV^Threshl is shovm in Figure 3. If VBV_2 
exceeds that threshold the downstream buffer is likely to overflow. 
5 The comparison of VBV_drift with VBV_Thresh3 is also shown in Figure 3. If 

VBV_2 drifts too far from VBV__1 then that too indicates that the downstream buffer 
is tending towards overflow. Also, VBV_drift is monitored to ensure that VBV l and 
VBV_2 do not diverge too much. The number of stuffing bits added to the GOP is 
chosen so as to reduce VBV_2 towards VBV_1 and to allow VBV_2 to remain greater 
10 than VBV_1 so as to reduce the likelihood of future underflow. Preferably the stuffing 
bits are added until VBV_2 = (BufiFer_si2e- VBV_Threshl) or (VBV_1+ 
VBV_Thresh3) whichever value of VBV_2 is smaller. 
Underflow and negative VBV drift 

Referring to Figure 4, which illustrates VBV_2 drifting from VBV_1 with a 

15 tendency towards underflow, the same values VBV_drift and VBV_2, which are 
determined once per GOP on the I frame at the start of each GOP, are used. In addition 
a value (Iframe_Offset) is used. This is preferably a predetermined fixed value 
representing the size of a typical I frame. Alternatively, it may be determined for each 
I frame by measuring the size of the I frame. The I frame_offset allows for the bits 

20 removed from the dovmstream buffer on decoding the I frame at the start of a GOP. 

To reduce the likelihood of underflow and to reduce negative VBV 
drift, the target number of bits per GOP is reduced at the start of each GOP and the 
degree of reuse of the preserved transcoding parameters is reduced as the drift 
increases and as the likelihood of underflow increases. To reduce the likelihood of 

25 underflow, the target number of bits for the GOP is reduced. By way of explanation, 
VBV_2 is the occupancy of the downstream buffer 10. The occupancy of the 
downstream buffer is the inverse of the occupancy of the buffer of the encoder. 
Reducing the target number of bits at the encoder results in an increase of the 
occupancy of the downstream buffer. 

30 In the present example: 

If (VBV_2 < VBV_Threshl+ Iframe^Offset) or ( VBV^drift < minus 
VBV_Thresh3) then the target number of bits for the GOP is reduced by a small 
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^* amount, the preserved transcoding parameters are reused on I and P frames, and B 

frames are recoded without rexasing preserved parameters. These criteria denote a small 
VBV drift towards underflow. The said small amount is for example the value of 
VBV_drift or a proportion thereof. 
5 If (VBV_2 < VBV_Thresh2+ Iframe_Offset) or ( VBVdrift < minus 

VBV_Thresh2) then the target number of bits for the GOP is reduced by a medium 
amount, the preserved transcoding parameters are reused on I frames, and B and P 
frames are recoded without reusing preserved parameters. These criteria denote a 
medivrai VBV drift towards imderflow. The said medium amount is for example the 
1 0 value of VB V_drift or a proportion thereof. 

If (VBV_2 < VBV_Thresh3+ Iframe_Oflfset) or ( VBVdrifl < minus 
VBV_Threshl) then the target nimiber of bits for the GOP is reduced by a large 
amount, the preserved transcoding parameters are not reused on any frames, and all the 
I, P and B frames are recoded without reusing preserved parameters. These criteria 
1 5 denote a large VBV drift towards underflow. The said large amount is for example the 
value of VB V_drift or a proportion thereof 

The amounts by which the target number of bits ( and thus bit rate) is changed 
are chosen to ensure that the rate of change of bit rate is within acceptable bounds. 

The above criteria all have two conditions (VBV_2 < VBV_ThreshX+ 
20 Iframe_Offset) and ( VBVdrift < minus VBV_ThreshY). The decision on how much to 
reduce the target number of bits and the degree of reuse of the transcoding parameters 
is preferably decided on the worst case of the two conditions. 

In this way, image quality is preserved as much as possible by reusing the 
transcoding parameters as much as possible. 
" 25 It will be noted that the condition VBV drift < minus VBV_ThreshY indicates 

that VBVdrift is more negative than VBV_ThreshY, which is a negative value itself 
In terms of magnitude then, |VBVdrift| >|VBV_ThreshY|. 

Example of Figures 5 and 6. 
30 Figure 5 shows an illustrative splicing system embodying the invention. 

Bitstreams A and B which are long GOP compressed bitstreams are supplied to inputs 
A and B of the system. The bitstream B is decoded to baseband and spliced onto the 
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r decoded baseband bitstream A at a splice point Splice by a splicer shown as a switch 

SI to produce a spliced baseband bitstream C which is reencoded by an encoder 6. The 
encoder 6 is controlled by a controller 61 which receives the preserved transcoding 
parameters from the decoded bitstreams. 
5 Referring to Figure 6, prior to time tO, a bitstream AO is fed from the input of a 

decoder 21 via a delay DA to input A of a switch 82 and thence to the output SO of the 
system. From time tl onwards to the splice time t2, AO is decoded by decoder 21 to 
baseband and fed to input A of a splicer SI. A bitstream BO is also decoded by a 
decoder 22 to baseband and fed to input B of the splicer SI. Up to time t2, the splicer 

10 SI feeds A to the output C of the splicer. After time t2, the splicer feeds B to the 
output C. The encoder 6 operates in a transition period tl to t3 in which the spliced 
bitstream is fully reencoded without use of, or v^th partial reuse of, preserved 
transcoding parameters. During this period reencoding is performed so as to provide a 
controlled transition from the VBV value of bitstream A to that of bitstream B. 

15 Preferably preserved I frame parameters are used to recode frames, which were 
originally I frames, as I frames. The manner in which that may be done is described in 
copending European patent application 00306699.0,(attomey reference 1-99-19, 
S99P5130, P/7372) which is incorporated herein by reference. At time t3, the VBV of 
the bitstream matches that of bitstream B. Receding of B continues from time t3 to 

20 time t4. At time t4, svsdtch S2 switches from input C to input B and compressed 
bitstream BO is supplied to the output SO of the system. During the time period t3 to t4, 
the encoder operates as described with reference to Figures 1, 3 and 4 in accordance 
with the mvention to reduce any drift of the VBV value of the bitstream produced by 
the encoder 6 from that of the original bitstream BO to ensure that at time t4 the VBV 

25 values match as closely as possible. 

Example of Figures 7 and 8. 

Figure 7 shows an illustrative splicing system embodying the invention. 
Bitstreams A and B which are long GOP compressed bitstreams are supplied to inputs 
A and B of the system. Bitstream A is decoded by a decoder 21 and reencoded by an 
30 intra encoder 141 to a compressed bitstream consisting of I frames. Bitstream B is 
decoded by a decoder 22 and reencoded by an intra encoder 142 to a compressed 
bitstream consisting of I frames. I frame bitstream B is spliced onto the I frame 
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bitstream A at a splice point Splice by a splicer 41 shown as a switch SI to produce a 
spliced I frame bitstream C. The I frame bitstream C is reencoded as a long GOP 
compressed bitstream by an I frame decoder 16 and an encoder 6. The encoder 6 is 
controlled by a controller 61 which receives the preserved transcoding parameters 
5 from the decoded bitstreams. 

The splicer 41 is typically in an intra frame studio. The bitstreams AI and BI 
are preferably stored in stores in the studio to be available for splicing. The spliced 
bitstream CI may be stored in a store in the studio. The stores may be tape and/or disc 
stores. 

10 Referring to Figure 8, from time tO onwards to the splice time t2, AO is 

decoded by decoder 21 and reencoded by an intra frame encoder 141 to I frames, 
reusing ,wherever possible, at least the preserved parameters of the I frames of the 
original bitstream AO, and fed to input AI of a splicer SI. A bitstream BO is also 
decoded by a decoder 22 and reencoded by an I frame encoder 142 to I frames, 

15 reusing, wherever possible, at least the preserved parameters of the I frames of the 
original bitstream Bb, and fed to input BI of the splicer 81. Up to time t2, the splicer 
SI feeds A to the output CI of the splicer. After time t2, the splicer feeds B to the 
output CI. The decoder 16 and encoder 6 operate in a transition period tl to t3 in 
which the spliced bitstream is frilly reencoded without use of, or with partial use of, 

20 preserved transcoding parameters. During this period reencoding is performed so as to 
provide a controlled transition from the VBV value of bitstream A to that of bitstream 
B. Preferably preserved I frame parameters are used to recede frames, which were 
originally I frames, as I frames. The manner in which that may be done is described in 
copending European patent application 00306696.6,(attomey reference 1-99-21, 

25 S99P5131, P7374) which is incorporated herein by reference. At time t3, the VBV of 
the bitstream C matches that of bitstream B. Receding of B continues from time t3 
onwards preferably with full reuse of transcoding parameters. If VBV drift occurs 
during the time period t3 onwards, the encoder 6 operates, as controlled by controller 
61, as described with reference to Figures 2, 3 and 4 in accordance with the invention 

30 to reduce any drift of the VBV value of the bitstream produced by the encoder 6 from 
that of the original bitstream BO. 
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It will be noted that in the embodiment of Figures 7 and 8, the bitstreams AO 
and BO are decoded and reencoded as I frames prior to time tl. The present invention 
may be applied in the encoders 141 and 142 prior to time tl whereever the reencoding 
makes full reuse of coding parameters. 

It will be appreciated that the invention may be implemented in a 
programmable digital signal processor controlled by a computer program. Thus a 
computer program product, which implements the techniques described herein when 
run on the processor, is envisaged as an aspect of this invention. 

Whilst the invention has been described in relation to the current MPEG2 
standard, it will be appreciated that it could be applied to other compression systems. 



THIS PAGE BLANK (uspto) 




1-00-66, P/1 01 13GB 15 



CLAIMS 

1 . A signal processing system comprising: 

a decoder for decoding a first compressed digital video bitstream whilst 
5 preserving the compression parameters thereof, the compression parameters including 
a first buffer occupancy value V_l representing the occupancy by the said first 
bitstream of a buffer of the decoder; 

a signal processor for processing the decompressed bitstream; and 
an encoder for compressing the processed bitstream to produce a 
10 second compressed bitstream having a target bit rate, optionally with reuse of the said 
compression parameters of the first bitstream, the second bitstream having a second 
occupancy value V_2 representing the occupancy of a downstream decoder buffer by 
the said second bitstream; 

wherein the encoder controls (i) the target bit rate of the second bitstream and 
1 5 (ii) the recoding of the second bitstream to meet the said target bit rate, 

the target bit rate being varied in dependence on one or both of (a) V_2 and (b) 
the difference between V_l and V_2, and 

the degree of reuse of the said preserved parameters being varied in 
dependence on one or both of (a) the degree to which V_2 tends towards underflow 
20 and (b) the degree to which V_l differs from V_2 tending towards underflow. 

2. A .system according to claim 1, wherein if V_2 is within a 
predetermined range of underflow of the downstream buffer, then the second bitstream 
is encoded without reuse of the preserved parameters, otherwise the second bitstream 

25 is encoded with reuse of at least some preserved parameters. 

3. A system according to claim 2, wherein if the difference between V_2 
and V_l exceeds a predetermined threshold value tending towards underflow of the 
downstream buffer, then the second bitstream is encoded without reuse of the 

30 preserved parameters, otherwise the second bitstream is encoded with reuse of at least 
some preserved parameters. 
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4 A system according to claim 3, wherein the compressed bitstreams 
comprise groups of intra frames and predicted frames, and if V_2 is less than a first 
W_0 threshold value Thl then the target bit rate is reduced by a small amount, and 
preserved transcoding parameters are reused on intra frames and at least some 
predicted frames. 

5 A system according to claim 3 or 4. wherein the compressed bitstreams 
comprise groups of intra frames and predicted frames, and if 1CV2.V1)| is greater than a 
first CV^-Vl) threshold, then the targe, bit rate is reduced by a small amount, and 
preserved tna«codmg parameters are reused on intra frames and at least some 

predicted frames. 

6 A system according to claim 4 or 5. wherein the groups of frames 
include I, P and B frames and I and P frames axe receded with reuse of the preserved 
parameters, and B frames are recoded without reusing preserved parameters 

7 A system according to claim 4, 5 or 6, wherein if V_2 is less than a 
second threshold value 11,2 , which is less than the said firs, threshold Thl then the 
target bit rate is reduced by a medium amount, and preserved transcoding parameters 
are reused on intra frames but not on predicted frames. 

8 A system according to claim 4, 5 6 or 7. wherein if|(V2-Vl)| is greater 
than a second (V 2-V 1) threshold but less than a third (V_2-V_l) threshold then the 

25 target bit rate is reduced by a medium amount, and preserved transcoding parameters 
are reused on intra frames but not on predicted frames. 

9 A system according to claim 4. 5. 6. 7 or 8, wherein if V_2 is less than a 
third threshold value Th3 . which is less than the said second threshold Th2, then the 

30 target bit rate is reduced by a large amount, and preserved transcoding parameters are 

not reused on any frames. 
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C 10. A system according to claim 4, 5, 6, 7, 8 or 9, wherein if |(V_2-V_1)| is 

greater than said third (V2-V1) threshold then the target bit rate is reduced by a large 
amount, and preserved transcoding parameters are not reused on any frames. 



5 11. A system according to any one of claims 1 to 10, wherein stuffing bits 

are added to the bitstream if V__2 is tending towards overflow of the downstream 
buffer and/or V_2 differs from V_l tending towards overflow. 

12. A signal processing system comprising: 

10 a decoder for decoding a first compressed digital video bitstream whilst 

preserving the compression parameters thereof, the compression parameters including 
a first buffer occupancy value V_l representing the occupancy by the said first 
bitstream of a buffer of the decoder; 

a signal processor for processing the decompressed bitstream; and 

15 an encoder for compressing the processed bitstream to produce a 

second compressed bitstream having a target bit rate, optionally v^th reuse of the said 
compression parameters of the first bitstream, the second bitstream having a second 
occupancy value V_2 representing the occupancy of a downstream decoder buffer by 
the said second bitstream; 

20 wherein the encoder controls (i) the target bit rate of the second bitstream and 

(ii) the recoding of the second bitstream to meet the said target bit rate, and 

if V_2 is tending towards overflow of the downstream buffer and/or V_2 
differs from V_l tending towards overflow of the downstream buffer, the encoder adds 
stuffing bits to the bitstream and recedes the second bitstream reusing the said 

25 preserved parameters. 

13. A system according to claim 12, wherein if V_2 is within a threshold 
range of the buffer size or (V_2 -V_l) exceeds a further threshold level tending 
towards overflow, then stuffing bits are added to the bitstream. 

30 

14. A system according to any preceding claim, wherein the said signal 
processor comprises one or more of: a store for storing the bitstream; and a 
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communications channel for transferring the bitstream from the decoder to the 
encoder. 

15. A system according to any preceding claim, wherein the said signal 
processor comprises £in editing apparatus. 

16. A system according to any one of claims 1 to 13, wherein the said 
signal processor comprises an intra-frame encoder to produce an intra frame bitstream, 
an intra frame signal processor and a decoder for decoding the processed intra frame 
bitstream to produce the said processed decompressed bitstream. 

17. A method of processing a signal comprising the steps of: 

decoding a first compressed digital video bitstream whilst preserving the 
compression parameters thereof, the compression parameters including a first buffer 
occupancy value V_l representing the occupancy by the said first bitstream of a buffer 
of the decoder; 

processing the decompressed bitstream; and 

compressing the processed bitstream to produce a second compressed 
bitstream having a target bit rate, optionally with reuse of the said compression 
parameters of the first bitstream, the second bitstream having a second occupancy 
value V_2 representing the occupancy of a downstream decoder buffer by the said 
second bitstream; 

wherein the encoding controls (i) the target bit rate of the second bitstream and 
(ii) the recoding of the second bitstream to meet the said target bit rate, 

the target bit rate being varied in dependence on one or both of (a) V_2 and (b) 
the difference between V_l and V__2, and 

the degree of reuse of the said preserved parameters being varied in 
dependence on one or both of (a) the degree to which V_2 tends towards underflow 
and (b) the degree to which V__l differs from V_2 tending towards underflow. 



18. 



A method of processing a signal comprising the steps of: 
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C decoding a first compressed digital video bitstream whilst preserving 

the compression parameters thereof, the compression parameters including a first 
buffer occupancy value V_l representing the occupancy by the said first bitstream of a 
buffer of the decoder; 
5 processing the decompressed bitstream; and 

compressing the processed bitstream to produce a second compressed 
bitstream having a target bit rate, optionally with reuse of the said compression 
parameters of the first bitstream, the second bitstream having a second occupancy 
value V_2 representing the occupancy of a downstream decoder buffer by the said 
10 second bitstream; 

wherein the encoding controls (i) the target bit rate of the second bitstream and 
(ii) the recoding of the second bitstream to meet the said target bit rate, and 

if V_2 is tending towards overflow of the downstream buffer and/or V_2 
differs from V_l tending towards overflow of the downstream buffer, the encoder adds 
15 stuffing bits to the bitstream and recodes the second bitstream reusing the said 
preserved parameters. 



19 A signal processing system substantially as hereinbefore described with 
reference to: Figures 1, 3 and 4 optionally as modified by Figures 5 and 6; or Figures 
20 2, 3 and 4 optionally as modified by Figures 7 and 8. 

20. A signal processing method substantially as hereinbefore described 
with reference to: Figures 1, 3 and 4 optionally as modified by Figures 5 and 6; or 
Figures 2, 3 and 4 optionally as modified by Figures 7 and 8, 

25 

21. A computer program product arranged to carry out the method of claim 
17, 18 and/or 20 when run on a programmable digital signal processing system. 
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ABSTRACT 
SIGNAL PROCESSING 

A decoder 2 decodes a first compressed digital video bitstream whilst 
preserving the compression parameters thereof, the compression peirameters including 
a first buffer occupancy value VBV_1 representing the occupancy by the said first 
bitstream of a buffer of the decoder. A signal processor 40 processes the decompressed 
bitstream. An encoder 6 compresses the processed bitstream to produce a second 
compressed bitstream having a target bit rate, optionally with reuse of the said 
compression parameters of the first bitstream, the second bitstream having a second 
occupancy value VBV_2 representing the occupancy of a downstream decoder buffer 
by the said second bitstream. The encoder controls (i) the target bit rate of the second 
bitstream and (ii) the recoding of the second bitstream to meet the said target bit rate, 

the target bit rate being varied in dependence on one or both of (a) VBV_2 and 
(b) the difference between VBV_1 and VBV_2, and 

the degree of reuse of the said preserved parameters being varied in 
dependence on one or both of (a) the degree to which VBV_2 tends towards underflow 
and (b) the degree to which VBV_1 differs from VBV_2 tending towards underflow. 

In addition, stuffing bits are added to the bitstream if VBV_2 is tending 
towards overflow of the downstream buffer and/or VBV_2 differs from VBV_1 
tending towards overflow. 

[Figures 1, 3 and 4]. 
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